Smart Exploration in HetNets: Minimizing Total Regret with mmWave

نویسندگان

  • Michael Wang
  • Aveek Dutta
  • Swapna Buccapatnam
  • Mung Chiang
چکیده

We model and analyze a User-Equipment (UE) based wireless network selection method where individuals act on their stochastic knowledge of the expected behavior off their available networks. In particular, we focus on networks with millimeter-wave (mmWave) radio. Modeling mmWave radio access technologies (RATs) as a stochastic 3-state process based on their physical layer characteristics in Line-of-Sight (LOS), NonLine-of-Sight (NLOS), and Outage states, we make the realistic assumption that users have no knowledge of the statistics of the RATs and must learn these while maximizing the throughput obtained. We develop an online learning-based approach to access network selection: a user-centric Multi-Armed Bandit Problem that incorporates the cost of switching access networks. We develop an online learning policy that groups network access to minimize costs for RAT selection, analyze the regret (loss due to uncertainty) of our algorithm. We also show that our algorithm obtains optimal regret and achieves 24% increase in total throughput compared to existing techniques for high throughput mmWave RATs that vary over a fast timescale.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Backhaul-Aware Decoupled Uplink and Downlink User Association, Subcarrier Allocation, and Power Control in FiWi HetNets

Decoupling the uplink and downlink user association improves the throughput of heterogeneous networks (HetNets) and balances the traffic load of macro- and small- base stations. Recently, fiber-wireless HetNets (FiWi-HetNets) have been considered as viable solutions for access networks. To improve the accuracy of user association and resource allocation algorithms in FiWi-HetNets, the capacity ...

متن کامل

Modeling and Analysis of MmWave Communications in Cache-enabled HetNets

In this paper, we consider a novel cache-enabled heterogeneous network (HetNet), where macro base stations (BSs) with traditional sub-6 GHz are overlaid by dense millimeter wave (mmWave) pico BSs. These two-tier BSs, which are modeled as two independent homogeneous Poisson Point Processes, cache multimedia contents following the popularity rank. High-capacity backhauls are utilized between macr...

متن کامل

Efficient Reinforcement Learning via Initial Pure Exploration

In several realistic situations, an interactive learning agent can practice and refine its strategy before going on to be evaluated. For instance, consider a student preparing for a series of tests. She would typically take a few practice tests to know which areas she needs to improve upon. Based of the scores she obtains in these practice tests, she would formulate a strategy for maximizing he...

متن کامل

Applications of Economic and Pricing Models for Resource Management in 5G Wireless Networks: A Survey

This paper presents a comprehensive literature review on applications of economic and pricing theory for resource management in the evolving fifth generation (5G) wireless networks. The 5G wireless networks are envisioned to overcome existing limitations of cellular networks in terms of data rate, capacity, latency, energy efficiency, spectrum efficiency, coverage, reliability, and cost per inf...

متن کامل

Evaluation of Influencing Factors on Tubal Sterilization Regret: A Cross-Sectional Study

Objective The aim of this study is to evaluate the menstrual pattern, sexual function, and anxiety, and depression in women with poststerilization regret, and potential influencing factors for regret following TL in Iranian women. MaterialsAndMethods In this cross-sectional study, 166 women with TL were subdivided into two groups including women with poststerilization regret (n=41) and women wi...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2016